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Three-dimensional images can be pixellated in three distinct 
ways: volumetric, holographic, and autostereoscopic. The lat- 
ter excels if images of opaque objects are to be displayed vt ///r 
wide fields of v/ew, and the qualiry of view-sequential displays 
with per view now appears adequate for general application. 
Although in principle autostereoscopic pLxellation gives a true 
three-dimensional image, l/ICf per view is needed to avoid flaws 
in a typical display. This approximately equals the diffraction limit, 
and the information content is no less than that of a hologram, 
A hybrid of holographic views and view-sequential multiplex- 
ing promises images with the field of view of autostereoscopic 
images but the significantly greater resolution and depth of holo- 
grams. Light valves and high-frame- rate arrays already have the 
space-bandwidth product needed to display such images, and 
further advances in photonic switches and gigahertz telecommu- 
nications look set to promote the display of such high-quality 
three-dimensional video images. 

Keywords — Displays, holographic, television. 3-D, three- 
dimensional, video. 

L Introduction 

Conventionally televised images are two dimensional (2- 
D) yet enable sufficient depth perception that surgeons, 
for example, are able to operate by them. Nevertheless, 
when depth perception is critical, as it is in manipulative 
activities like surgery, depth perception is quicker and 
more reliable if the images have a three-dimensional (3- 
D) content [1]. Television and video games are likely 
to be more realistic with three-dimensional images, and 
the human interpretation of complicated visual data more 
simple. There has therefore been a renewed interest in three- 
dimensional television, and while there has been detailed 
work [2] on the systems needed for this, a concentrated 
analysis is desirable of the component on whose radical 
evolution the rest of the system will depend; the display. 

It can come as a surprise to learn how little is needed 
to make a display for crude three-dimensional images. For 
example, one need merely take the liquid crystal display 
from a typical laptop computer, swap the back illuminator 
for a lens, and place a spot source of light some distance 
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light source 

Fig. 1. One can display a three-dimensional image by shouing 
views of the object on a liquid crystal display and illuminating 
each to an appropriate direction. 

behind the lens, as shown in Fig. I. The spot source might 
comprise a laser beam incident on a translucent screen, 
which under the action of the lens will illuminate the 
display with rays that converge to form an image of the 
source. Since the picture on the display will be visible only 
if observed from within the confines of the image of the 
source, the picture will have a restricted field of view. It is 
set up to be one view of a three-dimensional object. Other 
views of the three-dimensional object can be made visible 
to other areas by deflecting the laser beam to a different 
position for each view. If this operation is repeated at a rate 
sufficient to avoid flicker, and if the whole of the plane of 
convergence is illuminated, then the result will be a steady 
three-dimensional image even if. as will be shown later, the 
display is viewed away from the plane of convergence. 

The three-dimensional images formed by such a display 
will be crude because both the amorphous silicon transistors 
and the nematic liquid crystal typically found in a liquid 
crystal display switch too slowly to form more than one 
clear view. Funhermore, the size of the display will be 
limited by the complexity of liquid crystal displays, with 
the manufacture of large devices at present expensive. 

This example conveniently illustrates some features of 
creating three-dimensional displays. Because of the extra 
dimension, high-quality three-dimensional images require 
data for one to three orders of magnitude more pixels than 
two-dimensional images, dependent on resolution and the 
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Fig. 2. Volumelric 3-D displays, (a) Vibrating mirror, (b) Spinning LED's, (c) Spinning translucent 
screen, (d) Spinning phosphor disc, (e) Two-photon absorption, (f) Stacked LCD's. 



field of view. The first challenge faced by the designer 
is physically to distribute these data across the display *s 
screen at a sufficient rate. The second challenge is that of 
providing the screen itself with a sufficient space-bandwidth 
product, i.e., enough pixels each switching sufficiently 
quickly to transfer the data into modulated light. Last is 
the challenge of enabling the manufacture of a display with 
these properties without requiring prohibitive precision or 
cost. 

Each of these challenges is familiar to the designer of 
displays for high-definition two-dimensional images, and 
it is arguable that, pixellation and optics aside, three- 
dimensional video images are merely a technological exten- 
sion of their two-dimensional predecessors. Nevertheless, 
the variety of schemes recently put forward is bewildering, 
so this paper will proceed to review some of the more 
successful technologies and show that they comprise three 
distinct schemes: volumetric, holographic, and autostereo- 
scopic. One of these, autostereoscopic, shows promise 
but contains unwanted lines (flaws) at low resolution, so 
this paper goes on to quantify this. Section IV considers 
what resolution is needed for an autostereoscopic three- 
dimensional image to be free of such flaws and shows 
that for a typical size of display, one can do as well 
if not better with a hologram. Section V proposes a hy- 



brid of autostereoscopic and holographic pixellation, which 
gives the advantages of both. The sixth section shows 
how photonic devices make the display of such images 
possible. This paper concludes by evaluating the bandwidth 
of the latest photonic devices, noting the trend in three- 
dimensional display toward the integration of the display 
with the computer and the future dependence of both on 
advances in optical switches operating at gigahertz rates. 



IL A Review of Three-Di.mensional Video Displays 



A. Volumetric Displays 

One way of screening a three-dimensional image is to 
extend the principle of conventional television to the third 
dimension by making a device capable of emitting light at 
any point in a volume (Fig. 2). Perhaps the eariiesi way of 
doing this was to reflect light from a cathode ray tube off a 
circular mirror that vibrated like a loudspeaker [3). [4], An 
image of the cathode ray tube formed at varying distances 
from the mirror, thereby sweeping out a three-dimensional 
volume, but the supporting structure was heavy and the 
field of view limited. Light emitting diode screens [5]. (6] 
or laser-scanned displays [7]. (8] have been used instead of 
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Fig. 3. A ihrce-dimcnsionai arrav of light emuiers cannot display 
opaque ima^c^. 

a cathode ray tube, but the mechanism for scanning depth 
remains cumbersome. 

An almost unrestricted field of view can be provided by 
spinning a two-dimensional array of light emitters through 
a three-dimensional volume. Among other ways, this has 
been done with an array of light emitting diodes [9], a 
translucent screen that is scanned by lasers [iO]-[12], and 
a phosphor screen that is scanned (inside a vacuum) by 
electron beams [13]. The last way has the advantage of 
a cheap screen and scanning mechanism, but any rotating 
screen system has a singularity at the axis of rotation. 

An unrestricted field of view without an axis of singu- 
larity can be provided by scanning a pair of laser beams 
across a transparent material, which emits light isotropically 
where the laser beams intersect [14], [15]. An image of 
approximately one cubic centimeter has been demonstrated, 
but even a larger image would, like both vibrating- mirror 
and spinning-disc displays, provide only for the emission 
of light and not for its absorption. Each of these displays 
is therefore not able to provide opacity, so while the 
displayed images are three dimensional, they are necessarily 
translucent (Fig. 3). Schemes for the display of opaque 
images have been proposed — for example, stacking liquid 
crystal displays into a volume [16] — but even if these were 
interleaved with light emitters, the result would still be 
incapable of displaying reflections or specularity. 

The advantage of volumetric displays is that they can 
provide an unrestricted field of view without excessive data 
rates. This means that volumetric displays are not without 
potential application, for example, in air-traffic control or 
battle management. But the ideal is a device free of all 
optical restrictions. One device that can display any three- 
dimensional image with certainty is the hologram. 

B. Holographic Displays 

A hologram effectively freezes the optical wave fronts 
scattered off a three-dimensional object by recording their 
complex amplitude. Dynamic holograms are often proposed 
as a way of displaying a three-dimensional image [17] 
(Fig. 4). A gray-scale hologram is merely a high-resolution 
two-dimensional image, and conventional liquid crystal 
displays can be used to display such a hologram, albeit 
with a narrow (4=* at present) field of view [18], [19]. 
Wider fields of view require pixellation too fine for active 
matrix displays, but ferroelectric liquid crystal displays can 
be made with several thousand columns at realistic yields 
[20]. Nevertheless, this leaves the problem of bonding to 
several thousand connectors, which one scheme avoids by 
scanning the back of an optically addressed liquid crystal 



display with a cathode ray tube [21], [22]. Even with this 
improvement, the resolution of any liquid crystal display 
cannot be less than two or three times the cell gap, the result 
of which is to restrict the field of view of the hologram to 
a few degrees. 

Acousiooptic modulators provide phase modulation and 
have been used to display color dynamic holograms [23], 
[24]. The difficulties with scanning mirrors and bulk optics 
can to some extent be avoided [25], but once again, there 
is also the difficulty of modulating light at a resolution 
sufficient to get a wide field of view. For a 20^ field of 
view, a resolution of approximately 2.5 ^^m is needed, 
which, with the speed of sound in a typical acoustooptic 
crystal being 5 km-s~^ requires acoustic modulation at 
2 GHz. Because of the attenuation at such frequencies, 
the crystal must be kept smaller than the average display. 
Even if attenuation could be avoided, the data rates are 
too high for ease of operation. Operation can be eased by 
synthesizing the hologram within the crystal from a number 
of independently modulated frequencies, but unless the 
phase of these frequency constituents is actively controlled, 
the result is not a holographic reproduction of the original 
three-dimensional image. 

It is because of the need to reproduce optical phase that 
the data rates of a true holographic display are extreme. 
But the human eye is no more sensitive to the phase 
of a three-dimensional image than it is to the complete 
optical spectrum of a color image. Just as color images 
need comprise only red, green, and blue primaries, a 
three-dimensional image need comprise only the correct 
distribution of ray intensity versus position and direction 
that is specified by aulostereoscopic pixellation. 

C Autostereoscopic Displays 

Autostereoscopic displays are named to distinguish them 
from their stereoscopic predecessors, which require the 
user to wear spectacles. Stereoscopic displays require two 
separate views to be generated and then presented, one to 
each eye. Among the latest stereoscopic displays, one has 
spectacles comprising a pair of liquid crystal shutters that 
are synchronized to a screen that displays alternate left- 
and right-eye pictures; with a sufficiently high frame rate, 
the viewer sees a flicker-free image. The image provides 
stereopsis, i.e., the binocular perception of depth, but not 
kineopsis, which is the monocular perception of depth we 
accumulate by subconsciously moving our heads around a 
scene. Of the two, stereopsis is confined mainly to animals 
such as predators and primates who need to make instant 
estimates of depth, and it is arguable that even in these 
species, kineopsis is a more relied-upon determinant of 
depth in static simations. Viewers can experience nau- 
sea after prolonged viewing of stereoscopic displays [26], 
which may be due to subconscious awareness of the lack of 
kineopsis, but the real problem with stereoscopic displays 
is that spectacles get lost. 

Spectacles become unnecessary if each view is projected 
into one eye, which can be done using the display described 
in Section I. Such displays are called autostereoscopic 
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Fig. 4. Holographic 3-D displays. (□) Hologram on an LCD. (bi Hologram on an OASLM. 
(c) Acousiooptic hologram. 



(Fig. 5), a word that, like television, is an unhappy mix of 
Greek and Latin that seems peculiar to the display industry. 
One cannot expect a viewer to keep his head fixed merely 
for the convenience of the display, so one approach that 
is attracting great interest is to continually monitor the 
position of the viewers' heads and adjust the projection 
optics and visual content accordingly. 

More than one pair of eyes can in principle be tracked, 
and if the content of each view is matched to eye position, 
then the display can provide for both stereopsis and kJneop- 
sis. Furthermore, it might be possible to display views with 
approximately the right perspective by guessing the distance 
of each viewer from the screen through measurement of the 
distance between their eyes, so thai almost the only missing 
depth cue would be accommodation (the ability to focus 
on off-screen pixels). Although the resulting image would 
therefore be something short of truly three dimensional, it 
is unlikely that viewers would notice. 

The design of the display for such systems is relatively 
straightforward because the data rate of conventional video 
needs to be increased only by a factor of two (or four 
for two viewers, etc.) (27], [28], so that the major chal- 
lenge becomes that of identifying and tracking the viewers. 
Demonstrators have been built that require the viewer to 
wear an infrared reflecting spot [29] or a magnetic sensor 
[30]-[32], but many authors are coy on their plans for 
tracking bare heads [33]. 

An elegant approach is to side-illuminate the head with 
infrared light so that one eye is illuminated and the other 
in shadow [34], [35], but the shadows of more than one 
viewer can fall on each other. Another impressive approach 
is to track the hair/face boundary of viewers [36], while a 
system that tracks the eye, nose, and lips of a face has 
achieved 80% reliability with the face of the designer [37]. 
But the latter is slow, tracks only one face, and is less 
effective with a variety of faces. Advances in technologies 
like speech, handwriting, and object recognition mean that 
the day must surely come when systems will be aware of 
their surroundings, but the development of such machine 
intelligence will herald a new generation of computing, and 
progress in these areas so far has been slow. Meanwhile, 
the possibility of irritating glitches due to intermittently 
unfamiliar situations is never quite excluded, and users are 
notoriously intolerant of such weaknesses. 
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Multiple-view autostereoscopy makes the position of the 
viewers' heads irrelevant because the display projects views 
to every position where a viewer might be. It will be left 
until the next section to convince the skeptical that such 
an image can be truly three dimensional, but with the need 
for a many-fold increase in bandwidth, the design of the 
display now becomes daunting. 

The lenslet array is perhaps the longest established such 
auiostereoscopic technology [38]-[41], first developed to 
give three-dimensional photography and now being applied 
to displays. Each lenslet occupies the area that would be 
taken up by a single pixel if the display were configured 
for two-dimensional images, and underneath the lenslet is 
a series of subpixels (one for each view) whose emissions 
are collimated by the lenslet to the appropriate direction. 
Although lenslets magnify the dead zone between adjacent 
subpixels, this can be smoothed out [42]» but the numerical 
aperture of simple lenslets restricts the field of view of 
lenslet displays to a total angle of approximately 15*^. 
Outside this angle, the three-dimensional image repeats 
itself, which can be irritating. 

If an array of diffraction gratings is used instead of 
an anay of lenslets, it is possible to get wider fields of 
view without dead zones or repeating views [43]-[45], 
but both grating and lenslet array displays require an 
underlying display whose resolution is the product of 
the resolution of each view and the number of views: 
a substantial manufacturing challenge. Nevertheless, high- 
resolution displays are in prospect, and the latest lenslet 
array displays assembled in laboratories have eight views 
at color video graphics adaptor (VGA) resolution. 

High manufacturing yields are unnecessary if one makes 
a display by lining up several video projectors behind a lens 
[46], [47]. In this system, the projectors image one view 
each onto the lens, and the lens makes each view visible 
to a different direction. The projectors must be precisely 
aligned and have uniform brightness, and the projection 
lenses must be carefully designed to adjoin one another 
without perceptible gaps. 

Both lenslet arrays and multiprojecior systems multiplex 
the views of a three-dimensional image from spatially 
distinct subpixels, but one can also use the persistence 
of human vision to multiplex video images over time. It 
is possible to take what amounts to a single lenslet with 
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Fig. 5. Autostereoscoptc 3-D displays, (a) The leniicular array, (b) Parallel-illuminated LCD. 
(c) Linc-illuminaied LCD. (d) Multiple projectors, (c) Shuttered projector 





subpixels from a lenslet array display and raster scan it 
across a screen with spinning mirrors [48], but it is difficult 
to see how to multiplex across the whole screen in this way 
without moving parts. 

The alternative is to multiplex the views over time, 
and with the lenslet array display, this can be done by 
replacing the lenslet array with a low-resolution array of 
slits [49], [50]. Due to pin-hole optics, the slits act at 
any instant like lenslets, and with a low-resolution display 
underneath produce a low-resolution three-dimensional im- 
age. By scanning the slits over the underlying display, it is 
possible to time multiplex the equivalent of a full-resolution 
lenslet array but with no lens aberration and no need for 
high-resolution subpixels. Slits, however, waste light; a less 
wasteful method of getting the same optical effect is to 
exchange the slit for line illumination [51], [52]. Similar 
but perhaps less complex is the time-multiplexed concept 
described in Section I [53], [54]. Both laner approaches 
have the great virtue of wasting no more light than a 
conventional liquid crystal display, but both require a 
transmissive spatial light modulator with a high frame rate. 

Polycrystalline silicon transistors and ferroelectric liquid 
crystals each switch an order of magnitude faster than 
their amorphous silicon and nematic predecessors. Using 
these, a small liquid crystal display with a frame rate of I 
kHz has been demonstrated [55]. Cadmium selenide and 
amorphous diamond transistors also switch quickly, and 
fast-switching gray-scale modulation is made possible by 
the distoned helix and electroclinic effects, by monos- 
table or domain-switching ferroelectric liquid crystals, and 
by anlifenroelectric liquid crystals. Great resources were 
needed to develop even the existing liquid crystal displays. 



however, and greater confidence in the desirability of video 
three-dimensional images will be needed before advanced 
liquid crystal displays are developed. 

A time-multiplexed cousin of the multi projector system 
can be constructed by replacing the several projectors with 
a single large projector, whose projection lens covers the 
whole area filled by the multiple projectors [56], and 
placing over the lens a mechanical [57]-[59] or liquid 
crystal [60] shutter that blocks light from all but one area. 
At any instant, the projector does the same as one of the pro- 
jectors in the spatially multiplexed system, but at successive 
instants, different areas of the shutter are made transparent 
so that each view of the three-dimensional image can be 
projected in turn. Careful alignment is unnecessary, so a 
cathode ray tube can be used without the expense of beam 
indexing. Indeed, the concept is so fault tolerant that the 
author was able to assemble a crude system from a cheap 
video display unit and a couple of fresnel lenses. 

In the contest between spatial and time multiplexing, it 
is the spatially multiplexed lenslet array that seems to be 
receiving the most attention from manufacturers, perhaps 
because the high-resolution yields that are required present 
a manufacturing challenge of a kind that manufacturers 
have faced so successfully in the past. Certainly, the history 
of the semiconductor industry has seen inexorable increases 
in resolution, but there also have been increases in switch- 
ing speed of a similar magnitude, to those that will be 
needed for time-multiplexed three-dimensional video. 

It is arguably time multiplexing that has allowed the cath- 
ode ray tube to dominate the display of two-dimensional 
video, and a time-multiplexed 3-D projection system using 
cathode ray tubes produced an image comprising eight 
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monochrome VGA views several years ago. Despite being 
bulky and optically inefficient, this system is robust and 
flexible and continues to use the high data rate of cathode 
ray tubes to produce image qualities in advance of lenslet 
arrays. It is perhaps all the more remarkable that a crude 
concept with many similarities was built more than fifty 
years ago by Baird [61], [62]. 

The latest autostereoscopic displays produce images in 
which each view is visible across an arc of and there 
is a consensus among those who have seen such images 
that for the first generation of this technology. 1° per view 
will suffice. Experience with two-dimensional video has 
shown that expectations of resolution invariably increase, 
but Section IV will show that for a VGA picture, there is no 
point having an angle per view finer than O P. It follows 
that for subsequent generations of 3-D display, the angle 
per view for VGA resolution pictures will be somewhere 
between 0.1° and 1°, depending on perception and cost. 

If a display is to produce true three-dimensional images, 
then it should be able to project the image of pixels at 
various depths, and the viewer should see perspective that 
changes with their distance from the image. While it is clear 
that volumetric and holographic displays can do this, the 
description of autostereoscopic pixellation so far provided 
makes it less apparent that autostereosopic displays can 
also project true three-dimensional images. The next section 
aims to remedy this. 

ni. Coarse Autostereoscopic Pixellation 

With the first concepts for television it was proposed to 
use systems of spinning slits, and it is instructive to consider 
what happens if a spinning slit is placed in front of the 
hologram of a three-dimensional image. It is a matter for 
simple experiment to look at a three-dimensional object 
through a spinning slit, and it is observed that the scene is 
unchanged except for being dimmer and perhaps slightly 
blurred. A hologram should reproduce the wave fronts of 
a monochromatic three-dimensional image exactly, so a 
hologram seen through a spinning slit should also appear 
unchanged: What makes such an experiment significant is 
that the slit prevents superposition between light from areas 
of the hologram alternately exposed by the slit. So we can 
consider the hologram as an assemblage of independent slit- 
sized subholograms. The results of this experiment would 
be no different if a raster scanning hole were used instead 
of a spinning slit, so a hologram can be funher considered 
as a two-dimensional array of hole-sized subholograms. 

The subholograms are different from the pixels of a two- 
dimensional image in that the intensity of light is a function 
of direction from which the subhologram is observed, as 
well as a function of the subhologram's position. Since 
there are two coordinates of direction (azimuth and eleva- 
tion) as well as two coordinates of position, a system of 
four real coordinates is required for the true reproduction 
of a three-dimensional image. 

Now imagine that a second spinning slit is placed some 
distance away from the first, as shown in Fig. 6, and that it 
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Fig. 6. A three-dimensional object looks the same when seen 
through a pair of slits, one spinning rapidly and the other slowly. 

spins sufficiently quickly that there is no Moire fringing 
observed between the two. We would expect the three- 
dimensional scene to remain unchanged except for being 
yet dimmer and perhaps more blurred. Only light traveling 
from the first slit through the second will be exposed at 
a single instant, and if both slits are replaced by raster 
scanning holes of sufficiently small diameter, then the 
light passing through both will necessarily approximate to 
a single Gaussian ray. Because the second hole exposes 
rays traveling to different directions alternately, it removes 
superposition between the rays. It follows that even if it 
uses entirely incoherent light, a system that modulates rays 
as a function of both position and direction will suffice to 
display a true three-dimensional image. 

This thought experiment demonstrates that autostereo- 
scopic displays have the potential to produce true three- 
dimensional images, but the images will only be genuinely 
three dimensional if they comprise enough views, and the 
eight or so views available from existing autostereoscopic 
displays are too few. If the image is not genuinely three 
dimensional, how different does it look? 

Taking the display described in Section I as our model 
of explanation, imagine as before that the observer looks at 
a liquid crystal display in front of a lens but that the spot 
source of light behind the lens is created by illuminating 
one of an array of abutting light sources in the lens* focal 
plane. The image on a liquid crystal display is only entirely 
visible to an eye if at all points, the display is illuminated 
by rays of light that travel toward the eye. So the eye will 
only see the whole of one view if the eye is far from the 
display such as to subtend approximately the same angle 
to all points on the display. 

If, however, the eye moves closer to the display, it will 
subtend an increasingly different angle to one side of the 
display than the other. In the first instance, the screen will 
divide into two zones, one illuminated by one element 
of the array and one by that next to it. Since a different 
view appears with each element of the array, the image 
accumulated over time by the eye will be the equivalent of 
cutting the left half off one view and the right half off the 
other and sticking the two together. If the angle between 
views is fine, then the two views are similar enough that 
the edge between the two halves is unnoticeable. But if the 
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Fig. 7. Close lo the screen, a pefipectivc image is seen \*hose 
composition can be determined by ray tracing. 

true 3D image 

coarsely pixellated 3D image 
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Fig. 8. A plot of pixel direction Q versus pixel position A* can 
be used to identify what ihe viewer sees on the display, no n:iatter 
how distant it is. 

Spacing between views is coarse, then the content of each 
view differs markedly from that next to it, so that at the 
boundaries between halves, there is an image discontinuity 
that looks like a flaw line. 

Moving the eye closer still, the precise composition of 
the image seen can be determined by using the optical trick 
of tracing rays backward, as shown in Fig. 7. Starting with 
all those rays that reach the eye's pupiK one can trace their 
paths backward through the liquid crystal display and lens 
to the illuminators and, ignoring these, to a point where 
the rays all converge. All rays reaching the eye can be 
imagined to originate from this point so that it constitutes a 
vinual image of the eye's pupiL Lines drawn from this point 
through the edges of each element of the array intersect with 
the liquid crystal display to delineate the area of the liquid 
crystal display that is made visible by that element. 

It is the coarseness of view spacing that causes flaw 
lines rather than autostereoscopy itself because the process 
described above is exactly how one gets perspective with 
a real object. Far from the object, an eye will see a 
view comprising a parallel projection of the object in that 
direction, but close up, the eye will subtend a different angle 
to one side of the object than to the other. Therefore, the 
eye will see rays from one side of the object that are pan 
of a different parallel projection from rays from the other. 
Fig. 8 plots typical results showing schematically how the 
coarsely pixellated composition seen by the eye compares 
with the true 3-D image. 

The effects of Fig. 7 can be demonstrated on an au- 
tostereoscopic display by configuring each view as a hor- 
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Fig. 9. . Distant photograph of an auto stereoscopic display on 
which each view comprises a horizontal bar. (Permission for 
reprint, courtesy Society for Information Display.) 




Fig. 10. Close-up photograph of an autostcreoscopic display on 
which each view comprises a horizontal bar. (Permission for 
reprint, courtesy Society for Information Display.) 



izontal bar: the left-most view with the bar at the top of 
the screen, the right-most with the bar at the bottom, and 
the remainder spaced evenly between. Rather conveniently, 
the result is the synthesis of the diagram of Fig. 8: far 
from the display, a single view — i.e., a single horizontal 
bar — is visible, whereas close to the display, visible parts 
of different views comprise a staircase of bars, as shown 
in Figs. 9 and 10. 

It is tempting to suppose that the 3-D image generated 
by a shuttered cathode ray tube would be smoother if the 
scanning shutter was scanned continuously as each view 
was written on the cathode ray tube instead of being moved 
by a single shutter width between the display of each 
view [63]. The idea is that this continuous movement of 
the shutter might smooth discontinuities between adjacent 
views, which arise when the angles between them are tt)o 
coarse. Considering only the horizontal dimension, assume 
ihat as the cathode ray tube traces out the A' coordinate, the 
shutter gradually moves by one shutter width. This gives 
2 gradual change of B with A', so the pi.xeilation in the 
.V/0 diagram is slanted. There will be a distance from the 
display where someone looking at it will see a picture that 
can be represented on the diagram by a diagonal that is 
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parallel to the pixellation lines, so that at this distance, the 
viewer will see a single view. Tliis is exactly the result we 
would get if we put a weak lens in front of the screen of 
a conventional autostereoscopic display, so the 3-D image 
is not smoothed but merely distorted. 

Tolerant as the eye is of flaw lines between views, they 
nevertheless remain apparent. The claim that an autostereo- 
scopic display produces a true three-dimensional image can 
only be valid if the spacing between views is sufficiently 
fine; but just how fine is sufficient? 

IV. 3-D Pixellation 

The spacing of l*^ per view that was reported in Section II 
to be satisfactory for the present generation of displays 
requires 60 views for a typical field of view of 60"^. It 
is tempting to state that flaws will only be eliminated on an 
autostereoscopic display if views are as finely separated 
as the human eye can resolve [64], but it was one of 
the breakthroughs in the development of two-dimensional 
video to realize that such detail is unnecessary. This section 
assumes that a three-dimensional image will be acceptable 
if with the same pixel dimensions as the equivalent two- 
dimensional image, it can be displayed without flaws. 

The volumetric array is the format in which computer- 
aided design images are usually stored (indeed, perhaps this 
is how our minds memorize three-dimensional images), in 
which case the angle between each view need be no finer 
than the minimum difference in projection angle needed to 
render two views of such an array distinct- 

As physically perfect three-dimensional images, holo- 
grams have no flaws between views, and proponents some- 
times unwisely claim that all else is mere compromise. 
But as the previous section demonstrated, a hologram is 
no different to the eye from an autostereoscopic display 
where the direction of view is controlled by diffraction, so 
holograms will also subtend a measurable angle between 
views, which, although too fine to see, will be finite. There 
will therefore also be a calculable depth of field, even for 
a hologram. 

It is by relating the depth of field and angle per view 
between each pixellation scheme that the resolutions of 
differently pixellated images can be matched, and since 
one so often needs to display images of one format on 
a display of another, this section aims to formulate these 
relationships. 

Dealing first with a cubic volumetric array, geometric 
optics is sufficient to determine the angle through which 
a video camera must move before its image of the array 
is substantially changed. Staning the camera far from the 
array but with sufficient magnification that each pixel at 
the front of the array maps onto one in the video camera, 
there will be a certain sideways distance through which the 
camera must move before the column of pixels at one side 
of the rear of the array map onto a fresh column of video 
camera pixels. 

Fig. 11 shows that the angle subtended by this 
distance to the center front of the array equals the width 
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Fig. 11. Tm-o views or a cubic array arc formed by pjraltcl 
projection. The minimum angle (AH) beiwecn ihe views required 
for there to be a distinct difference in view content is that required 
to make one column of rear pixels fully \isible. 

of one array pixel -l.r divided by the depth z of the array 

d5 = :^. (I) 

If the width of each pixel equals its depth and the array 
is 71; pixels deep, it follows that 

^^=— . (2) 
n. 

So the effective angle between views of a volumetric 
display is the reciprocal of the number of depth pixels, and 
the angle subtended by each view on an autostereoscopic 
display must equal this if it is to show a flawless image 
of equivalent depth. This means, for example* that the 3-D 
equivalent of a VGA image comprising 640 by 480 pixels 
will need approximately 480 views in azimuth if it is to 
represent an array as deep as it is high over a field of view 
of 60^ (equal to about one radian). 

Volumetric displays usually can image only finite depths, 
but in principle, autostereoscopic and holographic displays 
can act as windows into a three-dimensional environment. 
If the environment is effectively infinitely deep, comprising, 
for example, an object with mountains in the background, 
must the angle between views be infinitesimal? 

The mistaken assumption in this question is that views of 
such an environment will be formed by parallel projection, 
i.e., to assume that views are formed by imaginary cameras 
far from the scene. In reality, the projections the cameras 
form will be not parallel but perspective, and each camera 
will be able to resolve fine resolution at a close distance 
but coarse resolution far away. The smallest object that can 
be resolved at any distance from the camera is equal to the 
width of view visible at that distance divided by the number 
of pixels per line in the camera. Rather than a uniform 
cubic array, a more appropriate test image is an array of 
volumetric pixels (voxels) in which the voxel dimension is 
proportional to the distance of the voxel from the camera, 
i.e., a distoned cubic array (Fig. 12). 

Through what angle can the direction of projection be 
rotated before the projected image changes? If one rotates 
about the frontal center of the cubic array, the limit on 
rotation without change is set once again by the rear voxels 
of the array. There will have been an unambiguous change 
m the projected image once the direction of projection has 
been changed sufficient to translate the image of the rear 
voxels by one voxel diameter. Simple geometry shows that 
as the depth of the cubic array tends to infinity, this angle 
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Fig. 12. In the left-hand video camerii. only the from pixels of 
the distorted cubic array are visible, while in the right-hand camera, 
one column of the rear pixels has become visible. As the depth of 
the distorted cubic array tends to infinity. RAY 1 and RAY 2 tend 
toward parallel, so the angle between adjacent views tends to the 
angle between adjacent pi.xels. 



autostereoscopic 
display 




^^./^ image of 
spot 



Fig- 13. An off-screen spot can be imaged by setting up rays to 
converse through it. 



equals the angle subtended by two voxels at the rear of the 
array to the camera. 

If each pixel in the image plane of the central camera 
is mapped to a voxel at the rear of the distorted cubic 
array, then the angle through which the camera can be 
rotated before the image changes equals the angle between 
its aperture and two adjacent pixels in its image plane. 
It follows that in order to televise a pixellated three- 
dimensional image of a scene whose depth tends toward 
infinity, the angle Ai9 between adjacent cameras should 
equal the cameras' field of view a divided by the number 
of pixels per line n^. 



(3) 



If such an image is to be accurately reproduced on an 
autostereoscopic display, then the angle at which rays from 
the edges of the display's screen converge should equal the 
field of view of the cameras. This is so that if the display 
is substituted for the original scene, the image recorded by 
the cameras is unchanged. Equation (3) therefore sets the 
angle between views on the display, so if a display with a 
field of view of 60"^ has VGA resolution views and is to act 
as an infinitely deep 3-D window, it needs approximately 
640 views in azimuth. 

While these translations between volumetric and au- 
tostereoscopic pixellation are correct geometrically, the 
angle per view of an autostereoscopic display is limited, 
and that of a holographic display is determined by the 
laws of diffraction- The angle between views on an 
autostereoscopic display cannot be less than the angular 
divergence SO of the rays that constitute each view, which 
is approximately determined by the wavelength A and the 
pixel diameter Ax according to the law of diffraction [65] 



S9 



A 



(4) 



The same approximate result can be derived in a more 
indirect manner from the gain-aperture relationship [66] that 
gain = 4t/{*^"i9)2 =r 4:r( Arca)/A2. It follows that 



Ai9 > 



Ax 



(5) 



Continuing with the example of a display acting as an 
infinitely deep 3-D window with a field of view of 60^ and 
VGA resolution views, the angle between views according 
to (3) was 1/640 radians. So with red light (A = 630 nm), 
(5) stipulates that the pixel size cannot be less than 0.4 mm. 
This is the approximate size of a pixel on a typical VGA 
monitor, so the restriction placed by diffraction on flawless 
autostereoscopically pixellated images is remarkably tight. 

The depth of field (z) of an autostereoscopic display is 
the maximum distance above the screen at which light can 
be made to converge (as shown in Fig. 13) to form the 
image of a pixel of diameter Ax. By trigonometry, this 
distance approximately equals the pixel diameter divided 
by the angle of ray divergence 

Equation (6) is essentially the same rule of geometry 
as (I) but referred to the coordinates of the display rather 
than those of the camera. Combining this with the law of 
diffraction given by (4) gives 



z < 



(Ax)^ 



(7) 



In Section III, it was noted that although a three- 
dimensional image can be seen through a pair of raster 
scanning holes, the image will be slightly blurred. This 
blurring is caused by diffraction, and if the diameter of both 
holes is Ax, then (7) sets the maximum distance z between 
the scanning holes. Should the distance nevertheless be 
made greater than this, then diffraction through the second 
hole would filter detail rastered by the first scanning hole 
such that its effective size would increase to that allowed 
by (7). 

Section III also noted that one can represent a single 
dimension of autostereoscopic pixellation on a diagram with 
coordinates of lateral angle 0 versus lateral position A'. 
But the spatial angular frequency kj, of light waves of 
wavelength A viewed in a plane intersecting the wave front 
at an angle 0 is given by 



kj: = — sm 6. 



(8) 



If autostereoscopic pixellation is represented instead by 
a plot of kj. versus X, then the dimensions of pixellation 
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Fig. 14, The minimum angle per view ( ) of a hologram equals 
(he angle of divergence {^d) of a single ray times the number of 
pixels {ftf) in a single row of the view. 

are limited by combining (8) and (5) to get the classic 
expression 

Akr ' Ax > 2-. (9) 

Depicting autostereoscopic pixellation as an array of 
independent subholograms of diameter Ax, (9) reaffirms 
that the minimum increment in spatial frequencies (AA:i) 
thai can be resolved by each subhologram is equal to 2t 
divided by its width (Ax). 

Consider the effect of (7) on the three-dimensional equiv- 
alent of a high-resolution monitor, where pixellation can 
be as small as 90 ^tm [67]. The maximum depth of a 
cubic array would then be only 16 nrun, so autostereoscopic 
systems are fundamentally inadequate for high-resolution 
3-D images. Only holographic pixellation will suffice. 

The angle between views on a hologram is also governed 
by the law of diffraction but in a slightly different way. 
The minimum divergence of any ray is determined not by 
the diameter of a pixel but, as shown in Fig. 14, by the 
diameter x of the whole hologram because the width of the 
wave fronts comprising the ray is ultimately limited by the 
edges of the hologram 

60='. (10) 

X 

If a lens in the far field is only big enough to capture 
this ray, the image it forms will comprise a single spot of 
light: this does not constitute a view. A lens large enough 
to capture two rays will form what is in effect an image 
comprised of two pixels. Therefore, to form an image 
comprised of Uj. pixels per line, the minimum angle of 
view that the lens must subtend is limes the minimum 
ray divergence 

A^>^. (11) 

X 

The lens will have to be moved through this entire angle 
before it forms a new and independent view, and if it is 
merely moved part of the way between, then it will form a 
superposition of the adjacent views. 

The choice of in this instance is somewhat arbitrary, 
but once made, then the smallest pi.xel diameter (Ax) that 
can be resolved on the hologram is by simple geometry 

Ax=-^. (12) 

18:6 



Combining this with (II) gives 

A^>^. (13) 
~ Ax 

This is exactly the same as (5), so if a hologram's pixel 
size is defined to be the same as that of a diffraction-limited 
autostereoscopic image, both have the same angle per 
view, and therefore both have the same information content 
for the same quality of three-dimensional image. Since it 
has already been shown that a fiawless autostereoscopic 
image with equivalent resolution and size to a conventional 
VGA monitor is at the diffraction limit, it follows that 
under typical conditions, a flawless autostereoscopic image 
contains no less information than a hologram. 

Diffraction effects will not maner with large displays, 
nor when cameras are imaging large scenes. But if high- 
resolution images are being formed of small-scale phenom- 
ena — as would be required, for example, in 3-D keyhole 
surgery — diffraction effects in the 3-D camera will need to 
be considered and will obey rules similar to those given 
above. 

The depth of field of a hologram is found by combining 
(6) and (10) 

So a hologram of width x = 20 cm, for example, 
illuminated by the light of wavelength A = 500 nm, could 
in theory project a spot of diameter Ax = 100 ;xm up to 
40 m from its surface. Closer to its surface, the smallest 
spot that a hologram can project is equal to its resolution, 
which in principle can be as small as one wavelength of 
light. Table 1 summarizes these relationships. 

One class of autostereoscopic displays is inherently ex- 
cepted from the restrictions described in this section — those 
that use coherent light or bulk optics. These are a special 
case because light is coherent across the optical wave front. 
So although if all the screen is opaque except for one pixel 
then light will diffract as with incoherent autostereoscopy* 
if several adjacent pixels on a bulk optical display are 
transparent, then light will diffract less. Indeed, one can 
imagine writing a zone plate on such a display in order to 
cause an off-screen pixel to come into focus somewhere 
above the screen. Displays of this kind make possible 
an intermediary between autostereoscopic and holographic 
pixellation by combining them. 

V. Hybrid Pixellation 

The ideal hologram has a minimum pixel size that is 
related to the maximum angle of view by (13). With 
the IO-/xm pixel width typical of present spatial light 
modulators operating on 500-nm wavelengths at the 
center of the visual spectrum, angles of view are limited 
to approximately 1/20 radian. So it is proposed to combine 
autostereoscopic and holographic pixellation into a hybrid 
scheme that interchanges the concept of projection of 
view over a range of angles, as already discussed for 
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Table 1 The Angle Per View {AH) and Depth (r) of the Three Pixellation Schemes 
Can Be Related By the Width of the Image ( r). the Depth of the Image in 
Pixels the Width of the Imago in Pixels (n^ ), the Field of View of 

the Image (n). the Pixel Size lA,/). and the Wavelength (A) 
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volumetric 


volumetric 






angle per view 
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A0 > — 
Ax 
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autostereoscopic systems, to the projection of a narrow- 
angle hologram over a range of views. 

The approximate algebra that explains the details of this 
concept is as follows. The light from a hologram is centered 
around the central wavelength and, for the purposes of this 
discussion, can be taken to be at one wavelength with a 
wave propagation vector whose magnitude k equals 2t/A. 
A one-dimensional range of angles will be considered, with 
giving the axial component of the wave propagation vec- 
tor and kj. giving the lateral component. For the purposes of 
this discussion, the approximation is made that k^ ^ 2n/X 
and the lateral angle of projection 0 ^ Xkj./27r. Ideally, 
then, one wishes to have the hologram projection into a 
range of angles, say -^9 to ^^9, with these angles then 
corresponding to values of Ar^ = —k to -h«:, respectively, 
where Xk/2k = ^9. If the complex field amplitude is 
E{kj.) corresponding to a direction determined by Ajx. then 
the near-fieid amplitude in the plane of the spatial light 
modulator is, say, E{X), where from the Fourier transform 
we get 



E(X 



dkx 



(15) 



Now we recognize that this could be accomplished by a 
superposition of /V narrow-angle holograms, each giving a 
total angle ^9 = A2/>c//V2t. Then, writing = 2k/i\\ 
one may split the hologram 



(16) 



where ^^^(A') expands thus; 

^» — K 4- rn A « 



^(^v) = ^ r E{k,)oxpUk.x] ^ 



The variable A;^ is changed for each range 



(17) 



(18) 



to give a narrower range for A;^ than for kj,. This lets us 
write 

.V 

E{X) = J2 exp{j[-^+ (m- i)AK]A-}E„,(.Y) 

m = l 

(19) 



where 



E^{X) 



+ (l/2)A« 



E^{k'^)expUk:X)^, (20) 



The exponential expression in (19) is the Fourier trans- 
form of S{-K -\- (m - so letting ET{ } denote the 
operation of taking a Fourier transform, we can write 



E{X) = Em{X)ET{6[k-\-K- {m- 



m = l 



(21) 



The values of Em{X) give the required near-field pattern 
on the spatial light modulator where the pixel width can 
now be as big as NX/ 9 but the mth holographic view is 
projected at an angle approximately equal to A(-k + (m - 
|)A/^]/27r. Since the operation of a lens on light traveling 
from one focal plane to the other can be represented by 
a Fourier transform [68], (21) indicates that the projection 
of each holographic view can be achieved by putting a 
lens behind the spatial light modulator and placing a point 
source of light representing the impulse in the focal plane 
of the lens. Of course, there is no such thing as a point 
source of light, and it is assumed that the summation of 
far-field intensities will be carried out time sequentially 
such as to give a summation of far-field intensities rather 
than the summation of complex amplitudes specified by the 
algebra. Furthermore, the details of the algebra will need 
alteration for realistically large angles, although the concept 
remains and will not materially change. Nevertheless, given 
the insensitivity of the eye to phase, (21) indicates that by 
exchanging the views displayed on the system described 
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in Section 1 with a series of holograms, and by replacing 
the scanning spot source of light with something as close 
as possible to a point source moving in discrete steps, the 
result will be a fault-free three-dimensional image. 

There is an imporrant issue for holograms produced by 
simply modulating the intensity of the light by a spatial 
light modulator. Such a hologram is often referred to as 
a binary phase hologram and produces symmetric panems 
for ±^'^. One can see that simply modulating an intensity 
pattern with a spatial light modulator will not be effective, 
as it will only be able to produce a series of symmetric 
patterns about each projected angle, even though the eye 
is insensitive to phase. It is consequently envisaged that a 
spatial light modulator designed to modulate four different 
phase levels will be required to remove this symmetry [69]. 

The field of view ^ of a hybrid three-dimensional image is 
the number of views no times the angle per view governed 
by (13) 

^ = n, A. (22) 

Assuming a flicker rate of 50 Hz, the frame rate of 
the spatial light modulator must be at least 50 n^Hz, and 
the limit of spatial periodicity will be the reciprocal of 
the pixel spacing (Ax). Defining space-time periodicity 
to equal the product of frame rate and the reciprocal of 
pixel spacing, (22) shows that for the display of a hybrid 
three-dimensional image with field of view the space- 
time periodicity must be greater than fifty times the field of 
view divided by the wavelength. For a one-radian field of 
view in azimuth with a wavelength of 500 nm, the space- 
time periodicity should approximately equal 1 Mbs~^cm~^ 
well above the 5-kbs~^cm"'^ capabilities of large high- 
resolution liquid crystal displays [67]. 

It might seem premature to be considering the ultimate 
resolution of three-dimensional video images when present 
resolutions are so much lower. But while the resolution 
of spatially multiplexed and time-multiplexed autostereo- 
scopic displays is limited by spatial resolution and frame 
rate, respectively, what the hybrid approach offers is the 
ability to interchange spatial and temporal periodicity. It 
is then the product of spatial and temporal periodicity 
that determines what three-dimensional resolution a de- 
vice makes possible, and devices already exist with the 
space-time periodicities necessary for high-resolution three- 
dimensional images. 

VL Advanced 3-D Displays 

If liquid crystal displays lack the space-time periodicity 
needed for hybrid pixellaiion, one device stands out for 
its lack of complexity and high space-time periodicity: the 
light valve (also known as an optically addressable spatial 
light modulator). Section II notes that video holograms 
have already been screened by optically addressing such 
a device with a cathode ray tube, but the field of view 
was narrow. By combining the frame rate of the latest light 
valves [70] with techniques for phase modulation [71], [72], 




high frame.^^ light 
rate array valve 

Fig. 15. An auiostereoscopic/'holographic dispU\ with j wide 
field of view can be made by time sequentially illuminating a 
high-resolution liquid crystal display, which can be assembled trom 
a light valve and a hich-frame-ratc array. 

it should be possible to effect hybrid pixellation so as to 
obtain considerably wider fields of view. The rate at which 
data must be fed to such a device in order for it to operate 
effectively equals the number of pixels in the device times 
its frame rate, called the space-bandwidth product. High- 
frame-rate arrays now have the space -bandwidth product 
needed to address light valves over large areas but tend 
to have fewer pixels and higher frame rates than light 
valves. Fig. 15 shows how the light valve can be addressed 
despite this by multiplexing the image of an array across 
its rear. The great advantage of this approach is that it 
removes from the screen (i.e., the light valve) the two 
most expensive items: the active matrix transistors and the 
connector array. One is then left with a screen that may 
be large but is uncomplicated and a small video projector 
that may be complicated but is not large. Both devices are 
therefore potentially cheap, and it is encouraging to note 
that arguably, it is just this division of size and complexity 
between phosphor screen and electron gun that made it so 
economic to manufacture cathode ray tubes. 

While hybrid pixellation provides for flawless three- 
dimensional images^ it remains unclear that users object 
to minor flaws, and autostereoscopic pixellation would 
certainly be the simplest to implement on such a device 
if it were fast enough. But the frame rate of the latest light 
valves seems to be limited to approximately 2 kHz by the 
resistor/capacitor time constant of the amorphous silicon. 
Dividing this by three for color and by 60 for flicker, one 
might get 30 views, but if these views have a typical 640 
pixels per line and are taken by cameras with a view of half 
a radian (approximately 30*^), then according to (2), for a 
flawless image the angle per view should be 1/1280 radians 
and the field of view of the device would be less than 1/40 
radians (approximately 1.5^). Of course, 30 views at the 
P per view that seems acceptable for the first generation 
of video three-dimensional images would result in a satis- 
factory field of view. But the optically addressed system 
is not a flat panel, and with autostereoscopic pixellation it 
would produce a three-dimensional image little better than 
the flat-panel active matrix liquid crystal display. The extra 
cost of the latter will eventually depend on how many get 
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made, but in large quantities it might be low enough to win 
over optical addressing. 

A typical light valve can resolve down to 10 /im, which 
with a frame rate of 2 kHz gives a space-time periodicity 
of 2 X 10^^ m~-s~^- After dividing by three for color and 
60 for flicker, one can estimate the solid angle available 
for viewing bv multiplying by A", equal approximately to 
(0.5 X 10"^) "m-. The result is a solid angle of view of 
0.025, equivalent to a viewing zone of. say, 30"^ in azimuth 
by 3"^ in elevation. 

Light valves are likely to be able to do better than this. 
Frame rates of 5 kHz have been reported [73] at the penalty 
of intense illumination (and a bistable liquid crystal), as 
have spatial resolutions of 5 /im. But before drawing 
optimistic conclusions, one should consider the problem of 
writing data to these devices at rates approaching 400 GHz 
for a 16 by 12 cm screen. 

An optical fiber is capable of transmitting data at such 
rates, and a simple method of scanning its output would be a 
tremendous prize both for displays and telecommunications. 
But existing acoustooptic devices can barely scan at I MHz, 
and optical amplifier arrays remain rather elementary. It 
was research into photonics that led to fast-switching light 
valves, and it is research into photonics that is producing 
some of the more promising ways of addressing them. If 
the addressing problem is simplified by requiring an image 
that is three dimensional only in azimuth, then for a 16-cm- 
wide screen with 240 interlaced lines, the data rate reduces 
to (frame rale x 1 /lateral resolution x width x number 
of lines) = (2000 x 10^ x 0.16 x 240/2) 4 GHz, This 
brings the data rate within the range of existing devices, and 
five stand out: acoustooptic holograms, cathode ray tubes, 
laser diode arrays, ferroelectric arrays, and micromirror 
arrays. 

Acoustooptic holograms have a successful history but are 
limited by the speed of sound in acoustooptic materials, 
which at 5 km/s restricts data rates to approximately 10 GHz 
for an optical wavelength of half a micrometer. In practice, 
even these rates are difficult because of the attenuation at 
high frequencies mentioned in Section 11. 

Cathode ray lubes can be electrostatically scanned at 
megahertz line rates, and, providing the deflection angle 
is narrow and the beam intensity is not too high, the spot 
size can be kept to a diameter of a few micrometers. But 
it is difficult to make such a small spot bright without 
defocusing, and a way must be found of fully modulating 
the intensity of a dense electron beam at more than I GHz. 
While these challenges are not insuperable, they remain 
challenges. 

Laser diode and other arrays work by demultiplexing the 
input to a sufficient resolution that raster scanning is either 
not required or need be no faster than can be executed by 
a liquid crystal hologram. An 18 x 1 laser diode array 
has been operated at 18 x I GHz, and 256 x 256 arrays 
have been fabricated, offering the tantalizing prospect of 
space-bandwidth products far in excess of any alternative. 

Ferroelectric arrays are fast-switching liquid crystal dis- 
plays where the active matrix transistors are etched in a 
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silicon integrated circuit. A 320 x 240 array with a potential 
frame rate of 20 kHz has been demonstrated [74], offering 
a space-bandwidth product of 1.5 GHz, which is getting 
close to that needed for a 16-cm-wide screen. 

Micromirror arrays [75] have the advantage of being 
comprised entirely of silicon, although they require a more 
intricate lithography. Nevenheless, arrays of 2048 x 1 152 
pixels potentially offer a space-bandwidth product of 5.8 
GHz. Details of circuitry aside, this offers the potential 
for a screen more than eight inches wide, and if three 
such devices were operated in parallel (which is how they 
are configured for high-definition 2-D projection), then one 
could hope for better quality still. But once again, optimistic 
conclusions are inappropriate, in this case because these 
devices merely convert data from an electronic form to an 
optical one; a source of data is still required. 

Whatever the capabilities of optical fiber, it seems highly 
probable that three-dimensional images will be compressed. 
The convention at present is that displays are connected 
to a video driver by a cable and that any decompression 
is effected by the video driver. But the data rates of raw 
three-dimensional video are so high that it seems pointless 
to decompress the signal remote from the display merely 
then to be presented with the challenge of transmitting a 
raw signal. Rather, the decompression should take place as 
close to the addressing device as possible (perhaps even 
within the addressing device), and it is convenient that 
both micromirror and ferroelectric arrays are mounted on 
carriers that plug direcdy into a printed circuit board. The 
complexity and output data rate of existing interfaces for 
three-dimensional video suggests that the decompression 
machine will have computational power comparable to that 
of a typical computer, and with the current trend for the 
display to dominate the cost of a computing system, it must 
be questioned whether there continues to be any advantage 
in going to the effort of separating the computer from the 
display. 

This section has brought the paper to a conclusion by at- 
tempting to demonstrate in some detail that it is practicable 
with existing technology to display a medium-sized color 
three-dimensional video image with no moving parts, an 
adequate field of view, and no flaw lines. Three-dimensional 
video is not some remote or esoteric prospect: it is a 
viable, analytic technology, and its development, like that 
for two-dimensional video, will depend on further progress 
in the three fundamentals of display technology — spatial 
demultiplexing, screen space-bandwidth product, and low 
cost per unit screen area. 

VII. Conclusions 

Video three-dimensional images can be pixellated in 
three ways: volumetric, holographic, and autostereoscopic. 
While volumetric images use bandwidth efficiently to give 
all-round viewing and holographic displays have high reso- 
lution, autostereoscopic displays image opaque objects with 
the wide fields of view needed for most applications. 

Autostereoscopic displays that track viewers' heads offer 
the prospect of greatly reduced data rates, but multiple-view 
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autostereoscopy avoids the need for machine intellisence. 
The latest such displays time-multiplex views to get the I"^ 
view spacing that seems adequate for the first generation 
of three-dimensional displays. 

Although acceptable in the short term, the images on 
autostereoscopic displays with \° per view are flawed and 
may come to irritate. For true three-dimensional images, the 
angle per view must be approximately l/IO"^ for an image 
640 pixels wide. At this spacing, even an autostereoscopic 
display with pixel diameter as big as 0.5 mm will be 
diffraction limited, and its data content no less than that 
of a hologram. Holograms have greater depths of field than 
autostereoscopic images and much greater resolution, and 
are vinually the only option for pixel sizes finer than 0.5 
mm. 

Holographic and time-multiplexed autostereoscopic 
pixellation schemes can be combined to give a hybrid 
that has the viraies of both. A sequentially illuminated 
holographic display has the same data content, resolution, 
and depth as a hologram but the field of view of an 
autostereosopic display. In principle, all that is needed is a 
liquid crystal display with a space-time periodicity of the 
order of 1 Mb-s'^ cm~\ but this is impractical over large 
areas at low cost. 

Faced with the demand for high space-bandwidth prod- 
ucts, the optical communications industry has developed 
light valves and high-frame-rate arrays sufficient to get the 
requisite space-time periodicities over large areas. Light 
valves are simple enough to operate over screen-sized areas 
at low device cost, and the arrays provide a way of spatially 
distributing data across the light valve that need not be 
expensive, provided they are small. Projecting a small array 
onto a large light valve therefore gives a display that is 
cheap and has high resolution for the same reasons that the 
cathode ray tube does. 

The high-frame-rate array should be as close as possible 
to the electronics that decompress the three-dimensional 
image in order to minimize high-data-rate connections. 
The computational power of the decompression electronics 
will be comparable to that of most computers, and it is 
not unlikely that the computer and display systems will 
therefore come to merge. 

The progress of two-dimensional video has since its 
invention been one of steady evolution toward increas- 
ing resolution and size, drawing on parallel advances in 
telecommunications. While the display of video three- 
dimensional images may seem revolutionary, this paper has 
sought to show that the pixellation and display optics are 
not unduly sophisticated and that the remaining challenges 
are the same as for two-dimensional video: an increase in 
the screen's space-bandwidth product, an increase in the 
rate at which data can be physically distributed across the 
screen, and the attainment of both in a single system without 
great complexity of manufacture. Photonic components 
developed for optical telecommunications already meet 
the requirements for three-dimensional video, and the two 
technologies are likely to continue to interact to their mutual 
benefit. 
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